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Abstract 

Generalizing the notion of relative entropy, the difference between a priori and a posteriori 
relative entropy for quantum systems is drawn. The former, known as quantum relative entropy, is 
associated with quantum states recognition. The latter — a posteriori relative quantum entropy is 
introduced and shown to be related with state reconstruction due to the following property: given 
^ , a density operator p, ensembles of pure states with Gibbs distribution with respect to the defined 

■ distance are proved to represent the initial state p up to an amount of white noise (completely 

mixed state) which can be made arbitrary small. 

In classical probability the relative entropy (or Kullback-Leibler distance) S(p\\a) of a distri- 
bution p — {pi, . . . ,p n } with respect to another distribution a = {c/i, . . . , q n } is defined as 

o 
S3 



cr 



S(p\\a) = { -£^ lo gfe) ifsupppCsupptr 



, . (!) 

-oo otherwise 



Usually, this notion is generalized in quantum information theory (see, e.g. [3] for a review) by analogy 
with von Neumann entropy, namely, the sum is replaced by operator trace. For two density operators 
p and a the quantum relative entropy 5(/j||cr) reads: 



— Tr [p (log p — log cr)] if supp p C supp a 
S(p\\a) = { (2) 
-f-oo otherwise 

Relative entropy and state recognition. Although relative entropy does not satisfy the triangle 
inequality and is therefore not a 'true' metric, it is a nonnegative convex function of {pk} and equals 
zero only if the distributions are equal, a = p. Its relevance to distinguishing probability distributions 
is vindicated by the Sanov's theorem £Q which states that the probability P^{p\a) that the state a 
passes the test determining if the state is p tends to 

P n (pW) -> const .e- NS b>\\°) (3) 

as N (the number of checked samples of cr) tends to oo. A quantum analog of Sanov theorem was 
also proved 2 . This shows that both classical and quantum relative entropy is an adequate tool to 
recognize states. 

Relative entropy from the operationalistic perspective. In this note I give a quantum oper- 
ationalistic analog of Kullback-Leibler distance For that, note that each probability qk can be 
treated in two ways 
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• a priori, that is as the probability of the event associated with the value q k of a to occur 

• a posteriori, that is, as the probability of the event associated with the value p k of p to occur 
provided the system was in state a 

Coming to quantum formula according to a priori interpretation, we get the standard quantum relative 
entropy (J2J) of p with respect to a. Following the second analogy, we get the relative entropy of p with 
respect to the post- measurement state, which is called Luders state @], it reads 

Pl[<t] = ^2\e k )(e k \cr\e k ){e k \ (4) 

k=l 

and describes the state of the system which was initially in state a after the measurement associated 
with the density operator p was carried out. Now we can introduce the distance between the states — 
the a posteriori quantum generalization of relative entropy — as follows 

L{p\\4>) = S(p\\p L [a}) (5) 

Note that the value of this distance may be finite when a = |</>)(</>| is a pure state and p is mixed, 
which is never the case for quantum relative entropy. For further purposes the explicit expression — an 

n 

analog of — for the distance function (JSJ) between a pure state 4> and mixed state p = Pk l e fe) ( e k\ 

k=l 

is to be written down: 

!— p k log ,t P uyi2 if bas nonzero overlap with p 
(6) 
+oo otherwise 

— a vector cf> is said to have j3) a nonzero overlap with p if (0|p|</>) ^ 0. 



Reconstructing quantum states by Gibbs ensembles. Given a full-range density operator p 
in H = C™, form a kind of Gibbs ensemble of pure states treating L {p\\<t>) as distance: 

fiM = Ke^>(-- £ L{p\\4>)) (7) 

where e > is a small parameter and K is & normalization constant with respect to Haar measure 
dS on the set CS n of unit vectors in H. This ensemble is associated with a density operator 

I( P ) = J p p {4>) \m\dS (8) 

cs™ 

and the following RECONSTRUCTION FORMULA holds: 

J UpW^MdS = (l-e)p + eA (9) 

CS" 

where A = — is the density matrix of white noise — a completely mixed state. The proof of this formula 
is a routine integration, see Appendix for details and the explicit expression for the normalization 
constant. 
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Limit distribution. The limit distribution in ijjjj corresponds to an ensemble £ whose density 
matrix is exactly p, let us describe it explicitly. According to 10, the support of the limit distribution 
is the set of unit vectors for which the a posteriori distance from p is zero, that is, supp(£) = {4'9i,...,e„ I 

£(pII<M,..a>) = °} with 



E 

k=l 



e 



Pk |e*,) 



where 6\, . . . , 9 n = . . . 2tt. Therefore the resulting distribution is uniform over the n-torus S 1 x 
• ■ ■ x S n and, as a consequence, any full-range density operator p can be represented as the following 

UNIFORM ENSEMBLE 

2-7T 27T 

\& 1 ,...,eJ(<j)e 1 ,...,9jd6 1 ---dO n (10) 



(2tt)" 



o o 



An example. Consider a density operator p whose spectral decomposition is 

P = \\o)(o\+l\i)(i\ (11) 

in two-dimensional real space H = R 2 . The picture below shows three expansions of p (note that in 
case of real state space the uniform ensemble (|10[l is discrete as the phase multiples are ±1) 



Gibbs ensemble (JjJJ Uniform ensemble Classical ensemble (|ll[l 
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Appendix: the proof of formula (0) 

Introduce the following numerical integral 



U\(e k \z)\ 2a "dS 



zecs„ fc_1 



for which the following lemma holds 

Lemma 1. For a±, . . . , a n > and (e^ | ej) = S^j 

2tt" IILir(a fc + i) 



jai . ..an. 



Proof. Represent C n as real space R 2n with coordinates (ri, (f>\\ . . . ; r n , (j) n ) so that (e^ | z) 
rfee*^. Write down the integral as 



c ... an = (27r) „ / n^ ifed5 

"'r2 + ...+r2=l fc=1 



Getting rid of r\ = \/l — r\ — ■ ■ ■ — r\ we obtain 



j=2 / \fc=2 



Now, integrating over r n , we obtain 



1 /• / n— l\/n— 1 



C"- = (2-)" • / dr n rl^ / II 



which, under the substitution £/. = r*/ yl — rj[ for = 2, . . . , n — 1 and r n = sin a reads 

= (2tt) b - r^dsina sin 2a " +1 acos 2ai a(cosa) 2(5:nlafc)+2(n " 2) x 
Jo 



n f ^ ■ 2a„+l ^ \ 2 (E fc-i a fc +n-2) + l r a 1 ...a n _i 

= 27r / sin " + (cosa) v ; da ■ I n _ 1 
Jo 

Using Legendre's formula 

" /2 • 2«+i 2B+1 , i r(« + i)r(/3 + 1) 

snT Q+i x cos p+ a; da; = - • — — ; — —- 

o 2 T(a + (3 + 2) 

we obtain the following recurrent expression 



f(Il-«n-l 

' i n-l 



r(a„ + 1)T (n - 1 + Sfe=i a k 

r (" + Efe=i a fe) 



Direct calculations show that the formula (|13fl satisfies the recurrent expression l|15|) . and it remains 
to prove the induction base. Do it for n = 1: 

If = d<f> ■ l p = 2tt 
Jo 

which also accords with (13) ■ This completes the proof. 

□ 

Now let A — Ylk=i a k l e fc)(efc| be a positive self-adjoint operator in H = C™. Introduce the 
operator integral 

HA) = J (f[\(e k \ti\ 2 A \d>)(d>\dS (16) 

cs» ^ fe=1 ' 

for which the following lemma holds. 

Lemma 2. For any positive self-adjoint operator A inH 

1(A) = r^t + TrA) ^ + 

Proof. First prove that /(A) is diagonal in the eigenbasis of A. For any j ^ k the appropriate matrix 
element reads 



( ei |I(A)|e fc ) - (2tt)"- 2 If* e^-^dfadfa [ T\r 2a *dS = 

J JO 7 r 2 + ...+r2=l f- 

Now calculate the diagonal elements 

(e k \I(A)\e k ) = ^ni^l^)| 2Q ') \(^\4>)\ 2 dS = I a n 
In the meantime it follows from O that 

jOi...(ofc+l)— On _ ja!...a„ a k + 1 



T(n + 1 + J2 l a t ) 
then /(A) = J2 k (ek\I(A)\e k ) ■ \e k )(e k \ , hence 

HA) = r(n ^ E ^ EK + i)l^l 

which completes the proof. □ 

Denote by A the density matrix of the white noise — a completely mixed state 

1 1 " 
A = -I = - V \e k )(e k \ 

n n ' 
fe=i 

then the exact version of formula © is stated by the following theorem. 
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Theorem 3. Let p = l e fc)(efc| be a positive (pk > 0) operator in H — C" . Then for any 

6 6(0,1) 



r(i + ?)e- 



(1- £ ) P + £ A = : ^ ' / e-^WM \4,){fldS (18) 

27r " nLi r ( 1 + " 7 



' CS" 

Proof. Consider the formula 1)17(1 and let A — ^~^-p, then = "^ 1 ~ £ - )Pfc and 
2^nLi r (l + «fc) /n(l-s). , ¥ \ _ f /7n/„ ■ J Aia"t 1 -)V 



T(l + n + TrA) 



iPOi — 1 / 



CS" 

thus, taking into account that Tr A — ra ^ 1 ~ e - > , we have 

^A p + i = Eii±i!_ / ^el^^wi- m ^ dS 

Using the definition © we obtain " ( - 1 ~ e ' ) p + I = 

r (i + 1) e " (1 7 c) ELiPtH? 



: = iPfc(logPfc-log|<e fc |0)| 2 ) |^^| ^ 



from which the formula ((18(1 follows directly. □ 
I emphasize that the formula 1(18(1 is exact. For small e we assume 1 — e ~ 1 and obtain the formula 
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